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The relation between fcrmion mixing and horizontal symmetry is discussed. 

1. Introduction 

Symmetry considerations have helped to create the Standard Model, can it also 
help us understand the mystery of three fermion generations? We shall see that it 
might for fermion mixing but not for their masses. Further details and references 
can be found in Ref. [1]. 

To simplify matters, I shall assume at the outset that all right-handed and heavy 
fermions have been integrated out so we are only left with the left-handed fermions 
to deal with. The effective 3x3 mass matrices are then M„ Aft, M^M], AfgA^], 
and M^, respectively for the up and the down quarks, the charged leptons and the 
Majorana neutrinos. I shall discuss the quark sector explicitly, but the conclusion 
thus reached is also valid in the lepton sector. 

The mixing matrix for the quarks is U — W^V, where W, V are the unitary ma- 
trices which render MuM^W and MdM'^^V diagonal. Equivalently, the three 
columns of W are the three eigenvectors of Af„Af^, and the three columns of V 
are the three eigenvectors of MdM^. Since the quark masses are all different, these 
eigenvectors are unique up to arbitrary phases. 

A horizontal symmetry is defined by a unitary matrix G which commutes with 
the mass matrices M„Mj^ and Af^Afj. As such, it must have the same eigenvectors 
as MuM^, and also the same eigenvectors as Af^Afj. If the eigenvalues of G are 
non-degenerate, then these two sets of eigenvectors must be the same. We can then 
set W = V , which results 'm U — 1 and no mixing. Even if an eigenvalue of G 
is doubly degenerate, the eigenvector for its non-degenerate eigenvalue must be 
common to G,MuMl, and M^M^, hence one of the three quarks does not mix. 
Neither agrees with Nature so it is not possible to have a horizontal symmetry 
common to the up and the down quarks. The best we can do is to have a horizontal 
symmetry F for the up quarks, and a different horizontal symmetry G for the down 
quarks. Thus whatever horizontal group that may be present at high energies must 
be broken down at present energies to these residual symmetries F and G. The 
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original horizontal symmetry group, which wc shall assume to be a finite group, 
must contain F and G and hence the finite group Q = {F, G} generated by them. 

Our task here is to find out the connection between the mixing matrix U and the 
horizontal symmetry group Q. In the next section we discuss what are the possible 
Q's for a given U. In the section after we discuss what are the possible [/'s for 
a given Q, how to construct the effective mass terms invariant under Q, and how 
to break them spontaneous to obtain the mixing patterns. Realistic neutrino and 
quark mixings are used to illustrate these relations. 

2. From U to Q 

Suppose U is given, say by experiments, then its horizontal symmetry group Q = 
{F, G} is determined by the residual symmetries F and G. To find them, it is 
convenient to work in the basis where M^Ml is diagonal. In that base W = 1 and 
U = V, so the eigenvectors of G are given by the columns of U. Since Q is a finite 
group, there must be an integer k so that G*^ = 1, hence the eigenvalues of G are 
the fcth roots of unity. As to F, it must be diagonal to be able to commute with 
MuMI, and its entries must all be the nth root of unity if i^" = 1. Thus there is a 
series of compatible F and G for each U, labeled by the integers k and n as well as 
their eigenvalues. We shall reject those {F, G) pairs which do not generate a finite 
group. 

The eigenvalues for F and G can each be chosen to be degenerate or non- 
degenerate. The former means that two of the three eigenvalues are the same, and 
the latter means that all three are different. These two situations are qualitatively 
distinct when wc try to recover U from a horizontal group Q, a topic we shall 
discuss in the next section. Since U is the diagonalization matrix for M^M^ when 
MuMl is diagonal, we need to know F and G in that basis. This can be achieved 
if F is non-degenerate, for then in the representation when F is diagonal, MuMI 
is automatically diagonal since it commutes with F. This is no longer the case if 
F is degenerate, so in order to be able to recover U from Q, we shall require F 
to be non-degenerate. What about G? If it is non-degenerate, then its eigenvectors 
assembled together constitute U. If it is degenerate, as it will be forced to be so 
for leptons, then only the eigenvector associated with its non-degenerate eigenvalue 
is fixed, so we can recover only one column of U. In order to obtain the whole U, 
Q needs to contain another residual symmetry G' which commutes with G, but 
with its non-degenerate eigenvalue in a different position than that of G. Then the 
non-degenerate eigenvector of G' yields a second column of U . Since U is unitary, 
its third column must be orthogonal to these two and is automatically determined 
once these two are given. In this way U can be completely recovered. By the way, 
when I say U is determined from 5, I always mean that its column vectors are 
known, but the ordering of them in U is never certain. That must be determined 
by experiments from the physics context. 

All of these work for the leptons as well, though with one additional constraint 



2, 2008 10:12 WSPC/INSTRUCTION FILE BeijingTalk2 



3 



already hinted above. The Majorana neutrino mass matrix is symmetric, as such it 
is diagonahzed by a unitary matrix V, but now to render V^M^V but not V^M^V 
diagonal. This forces G to have eigenvalues ±1. Wc shall choose the sign of G so 
that it has a single eigenvalue +1 and two eigenvalues —1. For a given U with 
columns Vi, three such G's exists and they are Gi = -l + 2v^vl. It can be verified 
that these three mutually commute, and the product of two of them is equal to the 
third, so any two can be chosen to be the G and G' discussed at the end of the 
last paragraph. If Q contains only one Gi, then that horizontal symmetry group can 
only predict one column of U, leaving the other two determined only by unitarity. 

Let me now illustrate these general discussions with two examples, one for neu- 
trino mixing, and one for quark mixing. 



2.1. Neutrino Mixing 

Within experimental errors, neutrino mixing can be described by the tribimaximal 
PMNS mixing matrix^ 

/ 2 V2 ON 
[/=-= -1^2 ^/3 , (1) 
^6 \-lV2-V3j 

from which we can work out the three Gj's. With = 1, the horizontal groups 

5i = {F, G^} are 

?: = 1 : 5*4, A(216); i = 2 : Ar, i = 3 : S3, A'(54), (2) 

where Sn is the symmetric (permutation) group of n objects and An is the alternat- 
ing (even permutation) group of n objects. A(216) is known as the Hessian group 
and is a finite subgroup of SU{3) with order 216, and A'(54) is one of its subgroups 
with order 54. The group generated by {F, G, G'} is identical to the group for i = 1. 



2.2. Quark Mixing 

We discuss here the mixing of two quarks; the mixing of three quarks is being 
investigated. For two quarks, the Cabibbo mixing matrix is 

where c = cos 0c, s = sin 0c, and 9c is the Cabibbo angle. We may choose F = 
diag(l, —1) which is non-degenerate, and for two generations there is only one G. 
It can be worked out from U to be 

V-S2 -C2J \-S2m C2mJ 

where c„ = cos{n6c) and s„ = sm{n6c)- The group G = {F,G} is a finite group if 
{GF)™ = 1 for some integer m; the group so generated is the dihedral group Dm- 
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According to (4), this calls for 9c = 7r/2TO. For m = 7, the value for A = sin 0c 
is 0.2225, which differs from the experimental value by something much less than 
A^/2, an error which we might expect to meet by neglecting the mixing with the 
third quark. 

3. Prom g toU 

For a finite group to be a horizontal symmetry group, clearly it must contain a 
three-dimensional representation. If the representation is reducible to three one- 
dimensional representations, then there is no mixing. If it is reducible to a one- and 
a two-dimensional irreducible representations, then the mixing matrix must have 

at least one zcro"'^. like that shown in cq. (1). So, for a generic mixing matrix, wc 
must consider groups Q with a three-dimensional irreducible representation. These 
groups are all finite subgroups of SU{2) or SU{3), and they are all known. Given 
one of these groups, any pair of group elements {F, G) such that F is non-degenerate 
is eligible to be the residual operators. For neutrino mixing, we also require G to 
have order two. Once this pair is chosen, we can compute the mixing matrix in 
the basis where F is diagonal. If G is non-degenerate, then U is completely known. 
Otherwise, one column per G can be so extracted. 

We also need to know how the full horizontal symmetry Q operates in the sym- 
metric phase, and how it is spontaneously broken to the residual symmetries {F, G) 
to obtain the desired mixing matrix U . Remembering that all the right-handed 
and heavy fermions have already been integrated out, the charged-lepton (e) mass 
terms in the symmetric phase are therefore of the form Cija{e^)iej{(t>e)a, and the 
Majorana neutrino {v) mass terms are of the form C!ijg^{v'^)iUj{4>v)a^ where Gija 
and Cj'j„ arc the Clebsch-Gordan coefficients to ensure a ^-invariant coupling, and 
the Higgs fields (/>e, (jiv may be simple or composite, and may be in any irreducible 
or reducible representations. 

The breakdown to residual symmetries is achieved by introducing suitable vac- 
uum expectation values to the Higgs fields, whence the charged-lepton mass ma- 
trix becomes {Mf.M^)ij = Cija{{4>e)a)i and the neutrino mass matrix becomes 
{Mi,)ij = Cljg^{{(f>u)a)- In order for F and G to be residual symmetries of the mass 
matrices, we must require 



where F" and G" are F and G in the representation of (<^e) and {(l>u), respectively. 

This condition is illustrated below in the case of neutrino mixing with the hori- 
zontal symmetry group Q = A4. From (2), we can see that this group corresponds to 
i = 2, so the mixing matrix U is expected to have the trimaximal mixing exhibited 
in the second column of (1). Indeed it does, if we go through the calculation using 



F" = (<^e), 



(5) 



(5). 
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3.1. From A4 to trimaximal mixing 

Ai has three l-dimensional and one 3-dimensional irreducible representations, la- 
beled as 1, 1', 1", 3. We follow Ref. [3] by taking to belong to 3, and six fields 
to belong to 1, 1', 1", 3. The 3-dimensional representation from (1) and (2) are 

/10 0\ 
F=\Ouj \ , G = G2 = - 

\ooLuy 

where w is a non-trivial cube root of unity. To satisfy (5) for the triplet (3) Higgs, we 
need (^e) to be proportional to (1, 0, 0)^, and {(j)'^^) to be proportional to (1, 1, 1)-^. 
The singlet representations (1, 1', 1") for G2 turns out to be 1 for all three of them, 
hence (5) is automatically satisfied for {(p^'^ 

4. Conclusion 

There is a connection between horizontal symmetry and fermion mixing, though 
none with fermion masses. The relation between horizontal symmetry and mixing is 
not simple: it is neither one to one, nor can the symmetry be imbrokcn. Nevertheless, 
from a mixing matrix U one can determine in principle all the finite horizontal 
groups Q that can lead to it. Conversely, from a given finite horizontal group G one 
can work out all the possible mixing patterns U. After the right-handed and heavy 
fermions are integrated out, we can construct the general mass terms invariant 
under Q, and work out how the full symmetry can be broken down to the residual 
symmetries of a particular mixing pattern. This general theory is illustrated with 
realistic neutrino and quark mixings. 
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